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ABSTRACT 

A two-part survey of Ohio employers of JTP (Job 
Training Partnership) Ohio Title IIA participants asJted 497 employers 
about: (1) their attitudes and opinions toward JTP Ohio and their 
participation in JTP programs (272 responses) and (2) employment and 
earning data for Title IIA participants who worked in the firm after 
ending their JTP training (326 responses). Analysis of the data found 
that, overall, the employers hold a moderately favorable opinion of 
JTP and JTP participants as employees. Nearly 52 percent of the 
employers would be "very lilcely" and 35 percent would be "somewhat 
likely to continue hiring JTP trainees. Employers also said that JTP 
trainees are a good source of skilled labor and that the benefits of 
participation in the program outweighed the costs. On the other hand, 
employers believed that JTP participants are below average in 
mathematics skills and they need more on the job training and more 
supervision than nonparticipants. The most important reasons for 
employer participation in JTP are wage subsidy and lowered 
recruitment costs. Part two of the study was a survey of 4,012 
completers of JTP Ohio training progrsuns. There were many 
discrepancies between employee- and employer-reported data on 
employment dates, wages, and reasons for job leaving. Recommendations 
were made to enhance the job progrcun and to improve data recording 
instruments. The employer and employee survey instruments are 
appended. (KC) 
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FOREWORD 



In 1986 the United States Department of Labor (DDL) mandated 
that the economic status of Job Training Partnership Act (JTPA) 
clients be determined 13 weeks after completion of a Job Training 
Partnership (JTP) program. Prior to this mandate, relatively 
little information was available to DOL about the long-term 
effects of participating in a JTP program. In Ohio, the Ohio 
Bureau of Employment Services administers programs authorized by 
JTPA. To administer the resources provided by JTPA successfully; 
DOL and OBES must have information on whether or not the programs 
are meeting the needs of clients. This first annual report 
addresses that need for information. It presents analyses of a 
survey of employees of title IIA JTP Ohio clients and assesses the 
accuracy of employee reports of employment and earnings informa- 
tion by comparing employee reports to employer reports. 

The study was conducted in the Evaluation and Policy division 
of the National Center under the direction of N.L. McCaslin, 
Associate Director. Dr. Lawrence Hotchkiss, Research Specialist, 
served as project director. We would like to thank Program 
Associate John Smythe and Dr. Dennis Benson, President of 
Appropriate Solutions, Inc., for their work in preparing this 
report. Special thanks are extended to Alice Worrell, Manager of 
Evaluation Services, Ohio Bureau of Employment Services, for her 
cooperation and patience, as well as the helpful insights she 
provided. 

We wish to thank Rodney Ferryman for the extensive computer 
programming that made the analysis possible. Special thanks goes 
to Mary J. Zuber who produced the typed manuscript and incor- 
porated the many revisions. 

Ray D. Ryan 
Executive Director 
The National Center for Research 
in Vocational Education 



vii 



EXECUTIVE SUMMARY 



This report contains findings from two parts of a survey of 
employers of JTP Ohio title IIA participants. The first part 
queries employer respondents about their attitudes and opinions 
toward JTP Ohio and their participation in JTP programs. Part two 
requests employment and earnings data for title IIA participants 
who worked in the firm after ending their JTP training. The 
analysis of part two data is conducted by comparing employee 
reports of their emploinnent and earnings to employer reports. 



Employer Attitudes 

Overall the findings indicate that employers hold a moderate- 
ly favorable opinion of JTP and JTP participants as employees. 
The indicator implying the most favorable assessment of JTP is a 
question about the likelihood of hiring JTP participants in the 
future. Nearly 52 percent of the employer respondents reported 
they would be "very likely" to hire JTP participants, and over 35 
percent said they would be "somewhat likely"— a total of about 87 
percent saying they probably would continue hiring JTP trainees. 
Of the remaining 13 percent, 7.1 percent indicated they didn't 
know, leaving just under 6 percent saying they probably would not 
hire JTP participants again. In a closely related question, 
employers reported that JTP trainees are a good source of skilled 
labor. 



In addition, employers stated that JTP participants ar-e 
better than nonparticipants in job application skills, appearance, 
getting along with their coworkers, work attitude, work quality, 
and productivity. Employers tend to believe that JTP participants 
are less prone to absenteeism, tardiness, theft, and vandalism on 
the job; but most employers indicate no difference between JTP 
participants and nonparticipants. Employers also reported by a 
wide margin that the benefits of their participation in JTP Ohio 
outweigh the costs. A fairly high percentage (20) had no opinion, 
however. *^ 



On the other hand, employers expressed belief that JTP par- 
ticipants are below average in math skills, need more OJT than 
nonparticipants, and need more supervision than nonparticipants. 
Only the last of these three items has an average that falls below 
the midpoint far enough to be significant statistically, however. 

The most important reasons for employer participation in JTP 
are wage subsidy and lowered recruitment costs. The least impor- 
tant raason is to "help the corporate image." 
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Aqr^eaent between Emplo yee and ETnp ]ftYAr 

The study containe comparisons between employee and emolover 
lllTi'^ f??,^}^ •S^i^^r^K*"? factors. ^hesS fSS?i?r 

IIa^a.^ /J^ J^^"^ 5' (2) ending date of the job, if 

?2? wLihlr.**°?Tfi P!"" earnings per week; 

ill ?«S ?J (6) reason for leaving 

SSler?.' f^^^^ ^''"^ variables are ' 

nimerlc, the other two nominal. 

nu»«r.T!!®,,!J?!!Siff •mployee and employer reports on the four 
numeric variables are nearly equal to each other. None of the 
SlfSi^^^JZ®"'^^**^®^ differences of means are statistically signifi- 

comparisons of means are not good indicators of the 
JS^rSr*'!** correspondence of employee and employer reports, but 

practically no tendency for emplo^eeJ to uSder- or 
«a^ning«' starting date, or ending date. In 
contrast to the near equality of means, there is only a loose 
correspondence between employee and employer reports for indivi- 

SaSin^^S^'K Vii ^^"^ f*i^ly large in absolute 

magnitude, but they average out to near zero. 

In assessing these results it is important to recognize that 
employee reports referred to an earlier time point than^mploye? 
reports, and wording of questions and manner of constructing 
operationel definitions of variables differed somewhat between 
employees and employers. Still, the starting date of the job 
should not be affected by the timing, and the operational proce- 

identical for the two respondents. ^yH, 
i«a«t accurately measured of the four vari- 
thiSresultf employees may be the primary explanation of 

wh«i.h^5®..r^**®"f® regarding employee-employer agreement about 

? employee was still working at the firm at the time of 
the interview is somewhat ambiguous because the reference time 
?S:"LfSI«J-Pi°^**f earlier than for employers. Nevertheless, 
the evidence here is encouraging in that at least 97 percent of 
the employers' reports that former JTP clients were still employed 
were in agreement with the clients' reports. The major disagree- 
ment occurred when former clients reported they were still em- 
ployed, but employers said they were not. 

Since most JTP clients in the employer survey were still 
working at the firm at the time of the interview and there are 
many possible reasons for leaving a firm, the table cross-classi- 
fying employee with employer stated reason for leaving has many 
cells with no entries and all remaining cells with few cases. 
Based on this limited evidence, it is apparent that the primary 
discrepancies between employee and employer reports concern being 
fired. Not in 1 instance out of 4 employee reports of being fired 
and 21 employer reports of firing do the reports agree. 



The favorable opinions held by employers regarding JTP and 
JTP clients are encouraging, it seems likely that these opinions 
reflect the fact that, as shown in the title IIA statewide report, 
the programs do work roughly as intended. It must be kept in 
mind, though, that most employer responses are neutral, and the 
response rate for part one of the employer survey is fairly low. 

The low to moderate accuracy of employee reports of dates of 
employment, hours, and earnings must be a cause for concern, 
however. The results here suggest that it would be useful to 
(1) improve procedures for obtaining employment and earnings data 
from employees and (2) improve assessment procedures for deter- 
mining the accuracy of employee reports, improving measurement 
procedures may depend on diagnosing the errors. The diagnosis 
must depend on carefully formulated checks between employee re- 
ports and employer records. 
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CHAPTER 1 
INTRODUCTIOK 



The Ohio Bureau of Employment Services (OBES) administers 
many training programs under the auspices of the Job Training 
Partnership Act (JTPA) . This report is part of a sequence of 
reports designed to provide OBES with detailed data that can be 
used in the evaluation of these training programs. It contains 
the analysis of a survey of employers of title IIA JTP Ohio 
clients. In addition, the sequence contains a report of detailed 
data by SDA for title IIA clients, a statewide summary for title 
IIA clients, and a report of title III clients. 

Data for this report are taken from two sources. The primary 
source of inforaation was a sample of employers of former JTP Ohio 
title IIA clients. The second data source is a follow-up survey 
of individuals who received training under JTP Ohio training 
programs. A large sample (N « 4012 completions) of individuals 
receiving training under title IIA of the act is included in this 
survey. 

The present report is Intended to serve two functions: 
(1) to assess employer attitudes and opinions regarding their 
participation in JTP Ohio programs and (2) to provide a 
reliability check on the responses provided by members of the 
title IIA survey. The reliability checks are carried out by 
merging data from the employer survey with data from the title IIA 
survey, matching social security numbers on the two data files. 

The report is organized into three chapters following this 
introduction. Chapter 2 describes the procedures of the study, 
chapter 3 reports the findings, and the final chapter contains 
commentary and assessment. 
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CHAPTER 2 



PROCEDURES 



This chapter Is divided into four sections. The first sec- 
tion describes the employer survey. The second section describes 
the title IIA survey. The third contains operation^il definitions 
of all variables used in this report. The final section describes 
the analysis methodology. 



Employer Sample 

The survey identified the first employer of title IIA clients 
after ending JTP Ohio services. These employprs were compiled 
into a list that defined the sample frame for the employer survey. 
Only employers of title IIA clients who ended their JTP Ohio 
participation during the first 39 weeks of program year *86 
(1 July 1S86 through 31 March 1987) were included. Employer names 
were included in the list as often as they were listed by former 
JTP title IIA respondents. The probability of selection into the 
employer sample thus was determined by the frequency of hiring 
former title IIA participants. The sampling unit was 
establishment (not firm) . 

An initial sample of 505 different establishments was 
serected. Of these, eight were eliminated because they were out 
of business, they were self-employed former JTP clients, or there 
was a conflict of interest. Table 1 presents the disposition of 
the remaining 497 establishments. 

The employer survey is divided into two sections. Section 
one contains questions concerning employer attitudes and opinions. 
In large establishments the questionnaire was completed by an 
administrative officer of the establishment. Section two requests 
starting date, ending date, wage, hours, and reason for leaving 
(if not still employed) for each tormer JTP client at the 
establishment who was drawn in the employer sample. In larger 
firms, this information typically was supplied by a personnel 
administrator in a central office. In small firms, respondents 
varied; frequently the owner and CEO completed both parts of the 
employer survey. As shown in table 1, response rates for part two 
(65.6 percent) are much better than response rates for part one 
(54.7 percent) . 

The data collection was conducted by Appropriate Solutions, 
Inc., under subcontract to the National Center. Initial contacts 
with establishments were made by telephone to determine the cor- 
rect address and appropriate respondent in the firm. Question- 
naires for part one and part two of the survey were then mailed to 
the person identified by telephone. The cover letter identified 
OBES, OSU, and ASI as jointly responsible for the data collection, 
explained the importance of the survey, and gave directions for 
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TABLE 1 

DISPOSITION OP EMPLOYER SAMPLE 



Part 1: Employer Attitudes and Opinions 



Saapls fraas 
Qusstionnairss rstumed 
Aware of jtp participants 
Maxinun usable sample 



497 
272 
164 

157 



Percentage 
100.0 
54.7 
33.0 
31.6 



Part 2: Employer Verification 



Sample frame 

Questionnaires returned 

Employees verified 

Maximum usable employee sample 



JL 



497 
326 
355 
351 



Percentage 



100.0 
65.6 

98.9 



SSS^iJj 2? ^^^^ P*'^': ^« recipient of the questionnaire 

was not the appropriate respondent to one or both parts! Th" 
letter provided instructions to distribute the two^pS?; to the 

" was expects tiat 
records of the firm would be used to complete part two One to 
five telephone reminders were used to encourJgS wspoMenJS to 
return eompletftd mmstionn-i^— • Z.."!! 

Title TTA RiirveY 

folloJ2d**?i*Ji;i!?f?^^J*'* "»P^* of Ohio, we 

followed in detail the procedures outlined in the Technical 

fISi? n o;«?"^**I ^"^^^^ provided by the United States Department of 
Labor (1986) . AS prescribed by the TAG, title IIA sample sizes 

^^"^ * necessary to assure a 95 

percent confidence level for each Service Deliver^Area (ISa) . 

SJh'J'';^ collection was to attSpt to co»pi;te 

;:?eli Jjri^T ^fl«P»»on«- telephone interview follSSeS in 

tllti ^1 5^^ ^•f»i^««»«nts as described in the TAG. If after two 
weeks, the interviewer was unable to interview the terminee 
successfully by phone, a mail version of the questionnaire was 
sent. Five days after the mail survey was sent, a combination 

SSf^.f*"^?**-''.^*^^*'' ""^^l®** the terminee. If, 
after an additional 5 days, the sur^/ey was net returned, a seiond 

fSd\!;«'TILyr Jf,^*** «a» not returned 

and the terminee was still not successfully interviewed by 
telepl- ^B, his or her file was then classified as incomplete. 

^.kI*'!.??^ i«l«P5on« number for ASI's survey center was included 
i2JS?;<.I^^SST" telephone messages left for the 

terminee. This number was left with instructions encouraging the 
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terminee to call in to complete the interview. The "call-in" 
method of data acquisition proved highly successful and accounted 
for 20-30 percent of all completions. 

The title IIA survey was ongoing from the beginning of the 
program year (1 July 1986) through the end of March. Each week a 
sample frame of potential respondents was received from OBES. A 
sample was drawn and the data collection subcontractor (ASI) was 
permitted a 4-week window, starting at week 14 after the date of 
ending JTP services, to collect the data. Data collected referred 
to the 13-week follow-up period following the end of services. 

The title IIA questionnaire asks respondents to identify the 
starting date, the ending date, hours worked per week, and the 
reason for leaving the fir^t employer (if no longer employed) 
after ending participation in JTP Ohio programs, it is this data 
and the earnings data from a set of mandatory DOL questions that 
provide the basis for comparing employee to employer data. 



Variables 

Twenty-four items from part one of the employer survey were 
used in the analyses. Additionally, four indexes were constructed 
from these items. The complete employer questionnaire appears as 
appendix A to this report. The variables were defined by 
assigning nu™«rlc v?ilu^« to the response o'^^tions. T^he r.usie'^ic 
values used are given beside the response option in appendix A and 
in tabulations presented later in this report. 

The four indexes were constructed from the items to have a 
minimum possible value of 0 and a maximum of 10. The general 
formula to achieve this result is — 



Index « 10j?^xj - Xjmin)/(Xjmax - ^^min)/^ 

where 

xj = numeric value for item j (for each individual 

respondent) . 
^jmin '^^^ minimum possible value of Xj 
^jmax "^^^ maximum possible value of Xj 
m « Number of items in the index 

In special cases this formula simplifies; it is particularly 
simple in cases where the minimum values (Xj^in) are the same for 
all j, and the maximum values (xj^ax) constant for all j. In 
this case, the index can be calculated as follows: 
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index - 10 (x - Xniin)/R 

where x - ?Xj/in, x^in - the minimua value for all items, and R 

iJ^™ (theoretical) range - x^ax - Xnin- (Note that x is the 
average for each respondent over items.) Missing values for some 
items were handled by substituting the mean of the remaining 
items, after subtracting the item minimum and dividing the result 
by the item range. 



The four indices are defined as follows: 



Index 
Job Application 

Job Performance 



Employer Perceptions 



Job Related Outcomes 



Items 
Q2A — resume 

Q2B— interviewing skills 

Q2C — appearance 
Q2D — communication skills 
Q2E— math/computdtion skills 
Q2F— training/ job preparation 
Q2G — get along with coworkers 
Q2H— general work attitude 
Q2L — OJT required 
Q2M — supervision needed 
Q3 —work quality 
Q4 — productivity 
Q5 — good source of skilled 
labor 

09 --evpect to hire more JTP 

participants 
Q2I — turnover 
Q2J — absenteeism/tardiness 
Q2K— theft vandalism 



In these designations Q stands for question. These indexes are 
not necessarily unidimensional scales. No item analyses or factor 
analyses were conducted with the items; the indexes are simply 
intended to provide convenient summaries. 



Twelve variables were used to assess the agreement between 
employee and employer reports, six were taken from employee 
(title IIA) reports, and the other six contained the same 
information as the employee variables but were reported by the 
employer. Appendix B contains the employee questionnaire from 
which the employee variables were defined. (As noted previously, 
appendix A contains the employer questionnaire.) The content of 
the six variables and the question on which each is based for 
employees and employers is as follows: 
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15 



Employee 



Employer 



Starting date 



Q3B1 
Q3B2 
Q3C 
Q2A 



QIA 
QIB 



Ending date 
Hours/week 




Earnings/week 
Still employed 
Reason left 



Q3B2,Q3D 
Q3D 



Q1A,Q2 
Q2 



Dates were converted to decimal numbers using years as units. 
Dates with missing days were converted to decimal numbers by 
substituting 15 for the missing day. Dates with missing months or 
years were defined as missing values. The earnings from the 
employee data were defined as missing if the respondent had worked 
at more than one firm during the 13 -week follow-up period. This 
procedure was necessary to ensure that the earnings report of the 
title IIA respondent was for the same firm as the respondent to 
the employer survey (since the employer was the first employer 
after the JTP client ended participation in title IIA programs) . 

Data on employees' reasons for leaving firms are sparse 
because (1) most title IIA respondents remained with their firms 
during the follow-up, and (2) there were many reasons for 
temindtion. We therefore constructed pairs of dichotomous 
variables (one for employee, one for employer) indicating whether 
the title IIA respondent still worked at the firm at the time of 
the survey. One variable was defined from the ending date. (The 
ending date was given a special code to indicate the individual 
still worked at the firm) . The other variable was defined from 
the reason left. (Reason left also was given a special code if 
the individual had not left) . A double reliability check on 
whether the title IIA respondent was still working at the firm was 
conducted using these two pairs of variables. 



Most of the analysis is presented in the form of frequency/ 
percentage distributions and cross tabulations. The forms of 
prc-'itntation are quite common and require no exposition here. Two 
aspects of the analysis may not be self-explanatory, however; both 
are related to the assessment of employee-employer correspondence 
regarding dates, hours, earnings, and so forth. The first aspect 
is the test of significance of differences between mean values for 
the same content variable calculated from the employee and 
employer samples. The second has to do with summarizing the 
degree of case-by-case correspondence between individual employee 
and employer reports. 

One way to gauge employee-employer agreement is to compare 
the averages of employee reports to the corresponding averages of 
employer reports. It would be useful to conduct a statistical 
test of the null hypothesis that the two means are equal. How- 
ever, since the two samples are not independent of each other, the 
usual formula for the standard error of the difference between two 
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means is not appropriate, in fact, in the present case where 
employee and employer reports are positively correlated the usual 
formula would substantially overstate the standIrS er?or SSs 
tending to exaggerate the degree of agreement between employees 
and employers. The formula for the standard error of the differ- 
ence between two means calculated from independent random samples 

SE - (si2 + S22)/N I independence 

where SE stands for standard error; s i2 and s denote the 

""Z" ^ ?*"P^* 2, respectively; and N = the 

r""®^ ^" samples for the present 

application. For nonin dependent samples, the formula is— 

SE - (si^ - 2 $12 + S22)/N ' I nonindependent samples 

where $12 is the covariance between employee and employer 
oJKf^Ji™ 1° ii^^'^J^^* 5°*' seriously the first forSuli can 

? ? standard error in the case of earnings, the first 
formula (using sample standard deviations and N-1 in the 
denominator) yields an estimate of 10.5; whereas, the second 
formula yields 5.4. 

The means of the employee and employer reports could be the 

h!JLon f""*^" ^^'^^ ^'^^ P°°^ correspondence 

T« ?nJ L reports in case-by-case comparisons. Therefore, 
It is informative to summarize the degree of case-by-case cor- 
respondence. The most obvious comparison is to determine whether 
each employee report is exactly equal to the corresponding 

^'P°f?;, » ^iose correspondence between the two 

reports may still occur even if employer and employee reports are 
not the same, providing that the discrepancies are systematic. 

Both types of correspondence (exact equality, and systematic 
differences) may be of interest. For numeric variables, we there- 
fore present two summaries of the degree of correspondence. The 
most commonly used of the two is the square of the correlation 

SkJ*'*®? employee and employer reports for each numeric 
variable. This statistic gives the proportion of total variance 

1^®?/®^ ■ °^ "accounted for" by the employer 

report.! jt summarizes the degree to which employee reports can 
be predicted from a linear function of employer reports, according 

to the following formula j «-^ui«j.nij 

employee reoort = a + h* t e>^nr^^ rs\roy l.o»^,^>.^.\ - 

> C J— - '^C ^ A. w y 1 «3 

where a and b are constants, and e is the error of prediction. 

The second measure of correspondence summarize the degree of 
approximation to e xact equality between employee and employer 

1 Employee reports are treated as dependent variables, and 
employer reports as independent variables. 
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reports. If a « 0 and b = 1 in the above formula, then the error 
indicates departure from exact equality. A squared correlation 
calculated under this restriction (restricted r-square) indicates 
the degree of approximation to exact equality of employee and 
employer reports. The unrestricted and restricted squared corre- 
lations are reported together permitting assessment of the degree 
to which allowing a linear correspondence (as in the above 
formula) , rather than demanding equality, Improves the accuracy 
with which employee reports can be predicted from employer 
reports • 

A number of indexes of agreement could be used. For example, 
the average error disregarding direction is easy to interpret. We 
chose the squared correlation because (1) it ranges between o and 
1 (1 » perfect correspondence) ,2 (2) its unrestricted value can 
be interpreted as the proportion of "explained" variance, and 
(3) it is the most commonly used measure of association, thus per- 
mitting ready comparison to findings in other studies- 



2 The restricted r-square could feasibly be negative, but it 
could never be greater than 1.0. if negative it would mean that 
using the mean employee report as an estimate of each individual 
value would be more accurate than using employer reports as esti- 
mates. None of the restricted r-squares are negative in the 
present sample. 
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CHAPTER 3 



FINDINGS 

The findings are divided Into two sections • The first sec- 
tion summarizes employer opinions and attitudes — part one of the 
employer survey. The second section summarizes correspondence 
between employee and employer reports of employment variables — 
part two of the employer survey and the title IIA survey. 

Employer Attitudes and Opinions 

Employer responses to part one of the employer questionnaire 
are organized Into six broad content areas. These are (1) 
employer opinions of job application skills of JTP participants, 

(2) employer assessments of JTP participants* job performance, 

(3) employer perceptions of the JTP program as a source of 
employees, (4) employer perceptions of the cost-benefit ratio of 
participating in JTP, (5) employer opinions of job-related 
behaviors (turnover, absenteeism/tardiness, theft/vandalism) of 
JTP participants, and (6) employer reasons for hiring JTP 
participants. Items 1, 2, 3, and 5 are summarized by indexes, as 
described in chapter 2. The cost-benefit assessments of employers 
are indicated by a single question (Q8) . Four items Indicate 
reasons for participation (QIO) , but no index was constructed to 
summarize them. In addition, tables are presented indicating the 
nvunber of employees who were JTP participants for each firm and 
the Average length of ewployrnpnt of JTP p^trticipants. 

Table 2 summarizes employer opinions of JTP participants* job 
application skills. As in all the tables assessing attitudes or 

TABLE 2 



EMPLOYER OPINIONS OF JOB APPLICATION 
SKILLS OF JTP CLIENTS 







JTP EfflD 


ovees Are 










Skills 








No 




Standard 






BetterJ3i 




Uorse(l) 


0Dinion(2) 


Mean 


Deviation 


N 


Resune skills (Q2A> 


21 .2X 


53.2X 


4.5X 


21. 2X 




0.480 


156 


Interviewing 
















skills (Q2B) 


23.9 


58.7 


4.5 


12.9 




0.498 


155 


Index 










5!91**** 


2.183 


156 



NOTES: Nuneric values assigned to each response option are given in parenthesis 
following the option. 



The index is the average of the data present for each respondent of resune 
skills and interviewing skills, rescaled to a mininun of 0 and a 
maximun of 10. 

Significance tests are 2-tailed tests of the hypothesis that the mean equals 
the midpoint of the range (neutral) --2 for the items, 5 for the index. 
Significant values above the midpoint indicate positive enployer 
assessment of JTP participants. Significant values lower than the 
ffl1d*po1nt Indicate negative assessment. 
* p < 0.05 
** p < 0.01 
*** p < 0.001 
p < .0001 



opinions, statistical tests are reported indicating whether the 
opinion deviates from the neutral level— midpoint of the range. 
In the case of job application skills, employees report that JTP 
participants are above average. The deviations from neutral are 
small but they are highly statistically significant. 

Employer assessments of job performance of JTP participants 
are reported in table 3. As indicated by the index, overall, 
employer opinions are slightly above neutral (neutral - 5 on a 
ivO-point scale) , and the chance that the deviation from neutral is 
due to sampling error is less than the traditional o.05 level of 
significance. The small departure from neutral overall, however, 
masks variation among the components of the index. Employers have 
a favorable opinion of the appearance, training preparation, 
ability to get along with coworkers, work attitudes, work quality, 
and productivity of JTP participants. However, they have an 
unfavorable opinion of math skills (not significant) , needed OJT 
(not significant), and the amount of supervision needed. The 
positive assessment of work quality and productivity of JTP 
participants is particularly encouraging. 

As shown in table 4, employers appear to find JTP partici- 
pants to be an excellent source of employees. The deviations from 
the neutral point on both items and the index are the largest in 
any of the tables, and they are highly statistically significant. 



TABLE 3 



EMPLOYER ASSESSMENTS OF JOS PERFORMANCE 
OF JTP CLIENTS 



Traits 




JTP Ei» 


ovees Arei 




Mean 


Standard 
Deviation 


JL 


Better(3) 




Worse(l) 


Ko 

0Dlnion(2) 


Appearance (Q2C) 


16.7X 


69.2X 


6.4X 


7.7X 


2.''.0** 


0.471 


156 


Connunication (Q2D) 


11.0 


71.6 


10.3 


7,1 


2.01 


0.463 


155 


Math (Q2E) 


4.5 


63.0 


9.7 


22.7 


1.95 


0.376 


154 


Training (Q2F) 


21.9 


56.1 


10.3 


11.6 


2.12** 


0.558 


155 


Get aicng (Q2G) 


13.7 


79.7 


0.7 


5.9 


2.13**** 


0.357 


153 


work attitude (Q2H) 


23.1 


59.6 


9.0 


8.3 


2.14** 


0.550 


156 



Needs 






ovees 


Mean 


Standard 
Deviation 


JL 


Need 


JTP ErfDj 
NO 

pHf in 


Need 

Mor^(1) 


No 

Opinion{2) 


OJT needed (Q2L> 


13.6 


64.3 


16.2 


5.8 


1.97 


0.548 


154 


Supervision needed 


8.4 


68.8 


18.2 


4.5 


1.90* 


0.508 


154 


(Q2M) 

















12 



Table 3--£ontinyfid 



TraUt 



Work quaUty 

(03) 
Productivity 

(04) 
Index 



Much 



1.9 

1.9 



Better(4) 



23.2 
19.2 



JTP Ewplovecs Are 



NO 



63.2 



60.3 



V9r^t8) 



6.5 
11.5 



Much 



Don^t 



5.2 



7.1 



Wean 



3.21**** 

3.12* 

5.24* 



Standard 



0.578 
0.611 
1.515 



155 
156 
157 



NOTES: NiMerfc values assigr«d to each responae optiai are given in parenthesee following the 
option. 



Statistical tests are two-tailed tests against the null hypothesis that the mean is equal to 

the scale nid point (2 in the case of iteiMi from question 2, 3 for questions 3 and 4« 
and 5 for the composite index). 

The index has a minimum of 0 and a maximum of 10. It was defined as follows: IOC (Q2*1)/2 * 

(03*1 )/4 * (Q4-1)/4] Mhere 02 stands for the items in questions 2 (2C, d), 2F, 2G, 

2H, 2L, and 2M; 03 denotes question 3 and 04 stands for question 4. The mean of the 

remaining items for a given case was substituted for missing values. 

• p < 0.05 
^ o ni 

•** p < 0.001 
p < 0.0001 



TABLE 4 



EMPLOYER PERCEPTIONS OF THE JTP PROGRAM 



Perceptions 


Alwavs(5) 


Usual lv(4) 


JTP 


EiToloyees Arei* 




Mean 


Std. 


N 

156 


S.T.(3) 


Rarelv(2) 1 


ever(l) 


NO 

<toinion(3) 


JTP Good Source 
of Skilled 
L«bor (05) 


5.8 


36.5 


39.7 


7.1 


0.6 


10.3 


3.40**** 


0.733 




Very 

Likelv(5> 


Somewhat 
Likelv(4) 


Not Very 
Likelv(2) 


Not St 

All Likelvd) 


Don't 
Know(3) 




Std. 
Dev. 


H 




Likely to Hire 

More JTP (09) 

• — J. 


51.9 


35.3 

* 


3.2 

1 


2.6 


7.1 

1 — 


4.30**** 

7.13**** 

i_. _ 


0.927 

1.669 

1 


156 
156 



NOTES: Nuneric values assigned to each response option are given in parentheses after the option. 

Statisticel tests are two*tailed tests against the null hypothesis that the mean equals the 
mic^int of the range-3 for question 5, and for question 9, and S for the index. 

The index was defined as follows: 1.25 (05 ♦ 09-2). Its mlnimiffi possible value is 0, and 
its maximimi is 10. If one item were missing, the value of the other item was 
substituted for the missing vslue. 
* p < 0.05 
** p < 0.01 
•** p < 0.001 
p < 0.0001 
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TABLE 5 

EMPLOYER COST-BENEFIT ASSESSMENT (Q8) 



Costs outwslgh benefits 
Benefits outweigh costs 
Costs and benefits are 

about the sane 
No opinion 

Total 

Mean 

Standard deviation 
Significance 





Percentage 


V 


(1) 


6.5 


10 


(3) 


51.3 


79 


(2) 


22.1 


34 


(2) 


20.1 


31 




100.0 


154 



2.45 

0.616 

0.0001 



NOTES: Numeric values assigned to each response 
option are given In parentheses after 
the option. 

The statistical test Is a two-tailed test 
against the null hypothesis that the mean 
equals the middle value of the scale — 2.0. 

The positive assessment of the cost-benefit ratio reported In 
table 5 reinforces the view that employers find JTP participants a 
good source of employees. The average assessment of the cost- 
baneflt ratio Is over 70 percent of a standard deviation above the 
neutral point on the Item, and the deviation from neutral Is 
highly statistically significant. 

Table 6 shows some tendency for employers to believe that JTP 
participants are less prore to absenteeism, tardiness, theft, and 
vandalism on the job than are other employees. Discrepancies from 
neutral are small, however. The data show that employees believe 
that JTP participants are about as prone to job turnover as other 
employees. 

Reasons why employers participate In JTP are shown In 
table 7. These data Indicate that the wage subsidy Is the most 
Important reason for participation. However, lower recruitment 
costs also contribute. Lower training costs and contribution to 
the corporate image are not perceived to be as Important as the 
subsidy and lowered recruitment costs. 

Tables 8 and 9 show the number of JTP employees per firm and 
the average length of employment, respectively, it is noteworthy 
that 13 out of 119 firms (8.4 percent) report they did not hire 
any JTP participants in the last year. It is encouraging to find 
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that most JTP employees remain with the firm for more than a year 
(DKs excluded) . 

On balance, employers express a mildly favorable assessment 
of JTP. Particularly encouraging is the fact that they believe 
that JTP participants are more productive and do higher-quality 
work than nonparticipants and are good sources of trained em- 
ployees. A large majority of employers report that they will 
likely hire JTP participants again. Also, employers believe that 
the benefits outweigh the costs of participation. These positive 



TABLE 6 



EMPLOYER ASSESSMENT OF 
JTP CLIENTS' EMPLOYMENT -RELATED BEKAVIORS 



Behavior 




JTP 


Clients i 


Ire-- 


Mean 


Std. Dev 


N 


BetterO) 


S0me(2) 


Uorse(l) 


NO 

0Dinion(2) 


Turnover (Q2I) 


18.1 


50.3 


16.8 


14.8 


2.01 


0-592 


155 


Absenteeism/ 


16.0 


68.6 


7.7 


7.7 


2.08* 


0.481 


156 


Tardiness (Q2J) 
















Theft/vandalism 


6.5 


57.5 


1.3 


34.6 


2.05* 


0.276 


153 


(Q2IC) 












Index 










5.27 


1.794 


156 



NOTES: Numeric values assigned to each response option are given in 
parentheses after the option. 

The itatfiticat tcttts are twO'iai Lea t^-^ts against the null 
hypothesis that the mean equals the miapoint of the range (2 for 
Items 21, 2J, and 2IC, 5 for the index). 

The index is defined as follows: 

Index > 5(Q2I ♦ Q2J ♦ Q2IC-3)/3. Its minimum value is 0, and its 

maximum is 10. If an item were missing, the mean of the 

remaining items for a given case was substituted for the missing 

value. 

* p < 0.05. 



TABLE 7 



REASONS WHY EMPLOYERS PARTICIPATE 
IN JTP OHIO PROGRAMS 



Reason 


Extremely 
ImDOrtantfS) 


(4) 


(3) 


(2) 


Not all all 

irnportantd) 


Mean 


Std. Dev. 


N 


Lower Recruitment 


31. 2X 


17.0X 


19.9X 


13.5X 


18.4X 


3.29* 


1.491 


141 


coats (Q10A) 
















Lower training 


19.3 


18.6 


30.7 


11.4 


20.0 


3.06 


1.372 


140 


coats (Q10B) 
















Subsidy (Q10C) 


44.7 


20.6 


13.5 


6.4 


14.9 


3.74«*«« 


1.457 


141 


Help corporate 


14.3 


18.6 


26.4 


11.4 


29.3 


2.77 


1.416 


140 


image (Q10D) 

1 















NOTES: Nuneric values assigned to each response option are given in parenthesis 
after the option. ^ 

statistical tests are two-tailed tests against the null hypothesis that the 
mean equals the midpoint of the range (3). 

* p< .05 
*** p< .0001. 
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TABLE 8 






NUMBER OP JTP EMPLOYEES (Q6) 




liUBbttr of mnlovMa 


Psrcantaqia 


N 


Nontt 

1 
2 
3 
4 
5 
6 
7 
8 

10 

Kor* than 10 
Don't know 




8.4 

16.1 
6.5 
9.7 
5.2 
2.6 
4.5 
0.6 
3.9 
3.9 

15.5 

« «n «% 
« J • « 


13 
25 
10 
15 
8 
4 
7 
J. 
6 
6 
24 
36 



Mttan -7.86 (N - US) 

Standard deviation ■ 11.52 



NOTE: Don't knows ware omittad from calculation of 
naan and standard deviation. 



TABLE 9 



AVERAGE TENURE OF JTP CLIENT EMPLOYMENT (Q7) 



Tenure toi\ 


Percentaoe 


N 


1 to 3 Bonths (2) 

4 to 6 months (5) 

7 to 9 months (8) 
10 to 12 months (11) 
More than 12 months (18) 
Don't know (missing) 


8.4 
9.1 
7.1 
7.1 
40.3 
27.9 


13 
14 
11 
11 
f2 
43 


Total 


100.0 


154 



Mean 12. 80 (N - ill) 

Standard deviation 6.28 



NOTE: Numeric values assigned to each response option 
are given in parenthesis after the option. 
Calculation of the mean and standard deviation 
omitted the don't knows. 



findings must be tempered by several factors, however. The re- 
sponse rate is not good; a high proportion of DK responses may 
imply no strong opinions. Most responses are in the neutral 
categories. 
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Correspondence between Emp loyee and Employer Reports 



The methods of assessing the correspondence between employee 
and employer reports of numeric variables are described in detail 
in chapter 2. Table 10 presents the statistics described in 
chapter 2. To summarize briefly, a and b are the least-squares 
intercept and slope, respectively, in regressions where the em- 
ployee report is the dependent variable and the employer report is 
the independent variable. The r-square is the squared correlation 
from this regression. The restricted r-square summarizes degree 
of approximation to exact equality between employee and employer 
reports—under the restrictions that a«o and b«1.3 

The overall results in table lo show close agreement between 
the average employee and employer reports of starting date, ending 
date, hours per week, and earnings per week. None of the differ- 
ences are statistically significant, and the numeric values are 
close. 



However, case-by-case correspondence between employee and 
employer reports is generally low to moderate. The restricted 
r-square for starting date is especially low, indicating that em- 
ployees and employers do not agree about the date when the em- 
ployee started in the job. It is possible, however, to predict 



TABLE 10 



CORRESPONDENCE BETUEEN 
REPORTS OF START DATE. END 





Employee 


Employer 








Restri cted 




Variable 


Mean 


Mean 


a 


b 


r-sauare 


r-SQuare 


N 


Starting date 


86.4 


86.2 


38.5**** 


0.555**** 


0.5C4 


0.177 


314 


Ending date 


87.0 


86.9 


19.6** 


0.775** 


0.766 


0.700 


38 


Hourt/week 


37.2 


37.0 


11.9**** 


0.683**** 


0.363 


0.284 


320 


Earningt/ueek 


225.2 


233.5 


28.0* 


0.844** 


0.556 


0.532 


251 



EMPLOYEE AND EMPLOYER 
DATE, HOURS, AND EARNINGS 



NOTES: Testa of hypotheses against the two*tailed alternative that the mean 

reported by the employee equals the mean reported by the employer were 
carried out using the correction for correlated samples. None of the 
differences of means were statistically significant. 



The statistical test for a (intercept) is against the null hypothesis 
that a * 0. The statistical test for b (slope) is against the null 
hypothesis that b « 1 . 

The restricted r-square was calculated under the restriction that 
a « 0 and b « 1 . 
* p < .05 
** p « 01 

*** p < !6oi 

**** p < ,0001 



5 Note that the statistical tests on b are against the alternative 
that b»l, not against the usual alternative that b«o. 
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th« employee report of starting date from a linear function of the 
employer report with substantially better accuracy than using the 
nUJf^4.J?^i°X®^ report. The discrepancy between the restricted and 
^2^?! SJ?^ r*?"?''* starting date is the largest in the 
J ?il"K V"^^ reflected in the large deviation of a from 

LS??™ ° h '^^^ poorest correspondence between employer and 
employee reports (unrestricted r-square) is for hours. The fairlv 
good correspondence for earnings is encouraging given (i) the 

earnings are difficult to measure accurately, 
and (2) the difference between the operational definition of 
employee and employer reports of earnings. 

Table n and the bottom panel of table 12 report cross tabu- 
lations between employee and employer reports of whether the 

f^^}^ working at the firm at the time of the inter- 
Z:Sy* 5 derived from the ending-date questions, and 

«iL£""o?**® questions regarding reason for leaving the firm 
(see Chapter 2) . since the employer survey occurred later than 
the employee survey, it is possible for an employee to accurately 
report still working at the firm and the employer to accurately 
report that the individual is no longer working at the firm. The 
lower left cell (totals excluded) of the table therefore may 
contain consistent entries. The upper right cell clearly contains 
inaccurate reports, however, it is moderately encouraging, there- 
fore, to find just over 3 percent of the entries are in the upper 
right cell (11 cases cut of 351) . Because of the time lapse 
between the employee and employer surveys, however, it is 
difficult to assess the large number of entries in the lower left 



TABLE 11 

CORRESPONDENCE BETWEEN EMPLOYEE AND 
EMPLOYER REPORTS OF WHETHER STILL EMPLOYED 





Employer Report 




Employee Reuort 


HP 


Yes 


JTotal 


No 


30.6% 


3.4% 


14.8% 


Yes 


69.4 


96.6 


85.2 


Total 


100.0 


100.0 


100.0 




(124) 


(205) 


(351) 



,0 « 0.34fl fl2 - 0.121 

■ 42.6 df = 1 p< 0.0001 
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TABLE 12 

CORRESPONDENCE BETWEEN ENPLOYEE AND EMPLOYER 
REPORTS OF REASON FOR LEAVING/STILL THERE 









Ei»loy«r 


KMton 




























stm 




Ek»Iqvm RtMon 


Firod 


Health 


Job ond 


Laid off 


New Job 


Quit 


Other 


There 


Total 


Ffrtd 












2 




1 


4 


NMlth 


1 


1 












1 


3 


Job widid 


1 




1 










2 


4 


LRld Off 


1 




1 


8 




1 




2 


13 


Urn Job 


1 






1 


5 


5 




1 


13 


imMy f toon 










2 


1 




1 




TrtniportRtlon 


1 










1 




2 


4 


Don't knoM 










1 


4 


1 


1 


7 


iWW tlitrt 




2 


5 


U 


23 


24 




?15 


29? 


Total 


21 


3 


8 


23 


31 


38 


1 


226 


351 










EwDlover Reoort 










GMDlo^ RiDort 


Not Still Thero 


StUl There 


Total 




Not StUl Thort 


32.8X 




14.8X 




StfU Thort 


67.2 


95.1 




85.2 










100.0 


100.0 




100,0 




Total 




(125) 


(226) 




(351) 





J ■ 0.377 |2 ■ 0.142 

■ 49.8 df ■ 1 p < 0.0001 



NOTE: The aacond panel of the table waa conatructed by condenalr^ the nuRbera 
In the firat panel. 



cell. Some of these nay be accurate reports from both parties, 
but It Is un?lkely that all of then are. 

The upper panel of table 12 reports a crossclassif ication of 
enployee and employer statedl reasons for leaving the job. Entries 
are nunbers rather than percentages, due to the sparsity of en- 
tries in the taJsle. Because of the small N and large nximber of 
cells, no firm conclusions can be drawn from the table; however, 
some modest degree of agreement between employees and employers is 
apparent. The largest discrepancy occurs for ** fired." Only 4 
employees report being fired, and none of these are reported as 
fired by employer. In contrast employers report having fired 21 
employees, 16 of whom reported they were still working at the 
firm. Again, the time-lapse between the two surveys makes inter- 
pretation of this result ambiguous. 

The data indicate that employment and earnings information 
reported by employees are not very accurate. If employer reports 
are viewed as accurate — "true scores" in the parlance of measure- 
ment theory — then the unrestricted r-squares in table 10 are 
estimates of reliability (Lord and Novick 1968). These values are 
substantially below generally accepted standards in social science 
research. 
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Th«re ar« two factor* that must be considered before passing 
excessively harsh judgment on the accuracy of the JTP partici- 
pants' reports of employment and earnings data. First, the time 
point of reference and exact wording of the employee and employer 
questionnaires do not match. The earnings questions are quite 
different in the two surveys. The employee reports, in fact, are 
based on responses to a question about total earnings from all 
sources. Second, if employer reports also are viewed as fallible, 
as they surely must be, then the r-squares in table 10 understate 
the reliabilities of employee reports, in fact, if employee and 
employer reports are assumed to be equally reliable measures, then 
the correlation, rather than r-square, is the estimate of reli- 
ability. These correlations are 0.710 for starting date, 0.875 
for ending date, 0.602 for hours, and 0.745 for earnings. These 
are not exceptionally high reliabilities when compared to other 
social science data, but they are within the usual range reported 
for short attitude scales. 

On balance, it appears that jTP participant reports of em- 
ployment and earnings data are not so inaccurate that they invali- 
date all findings based on them, but there remains much room for 
improvement . 
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CHAPTER 4 



SUMMARY AND COMMENTARY 



This report contains findings from two parts of a survey of 
employers of JTP Ohio title IIA participants. The first part 
queries employer respondents about their attitudes and opinions 
toward JTP Ohio and their participation In JTP programs. Part two 
requests employment and earnings data for title IIA participants 
who worked In the firm after ending their JTP training. The 
analysis of part two data is conducted by comparing employee 
reports of their employment and earnings to employer reports. 

Overall the findings indicate that employers hold a moder- 
ately favorable opinion of JTP and of JTP participants as em- 
ployees. The indicator implying the most favorable assessment of 
JTP is a question about the chance of hiring JTP participants in 
the future. Nearly 52 percent of the employer respondents re- 
ported they would be "very likely" to hire JTP participants, and 
over 35 percent said they would be somewhat likely — a total of 
just 87 percent saying they probably would continue hiding JTP 
trainees. Of the remaining 13 percent, 7.1 percent Indicated they 
didn't know, leaving just under 6 percent saying they probably 
would not hire JTP participants again. In a closely related 
question, employers reported that JTP trainees are a good source 
of skilled labor. 

In addition, employers stated that JTP participants are 
better than nonparticlpants in job application skills, appearance, 
getting along with their coworkers, work attitude, work quality, 
and productivity. Employers tend to believe that JTP participants 
are less prone to absenteeism, tardiness, theft, and vaniallsm on 
the job, but most employers indicate no difference between JTP 
participants and nonparticlpants. Employers also reported by a 
wide margin that the benefits of their participation in JTP Ohio 
outweigh the costs. A fairly high percentage (20) had no opinion, 
however. 

On the other hand, employers expressed belief that JTP par- 
ticipants are below average in math skills, need more OJT than 
nonparticlpants, and need more supervision than nonparticlpants. 
Only the last of these three items has an average that falls below 
the midpoint far enough to be statistically significant, however. 

The most important reasons for employer participation in JTP 
are wage sxibsidy and lowered recruitment costs. The least impor- 
tant reason is to "help the corporate image." 

The report contains comparisons between employee and employer 
reports for six employment and earnings factors. These factors 
are (1) starting date of the job; (2) ending date of the job, if 
ended; (3) hours worked per week; (4) earnings per week; 
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(5) Whether still employed at the firm; and (6) reason for leaving 
the job, if applicable. The first four of these variables are 
numeric, the other two nominal. 

The means of the employee and employer reports on the four 
numeric variables are nearly equal to each other. None of the 
employee-employer differences of means are statistically signifi- 
cant. These comparisons of means are not good indicators of the 
case-by-case correspondence of employee and employer reports, but 
they do show practically no t^,ndency for employees to under- or 
overstate hours, earnings, starting date, or ending date. In 
contrast to the near equality of means, there is only a loose 
correspondence between employee and employer reports for indivi- 
dual cases. This means that errors are fairly large in absolute 
magnitude, but they average out to near zero. Restricted 
r-squares measuring the degree of approximation to exact equality 
of employee and employer reports show substantial errors of re- 
porting. Starting date shows a particularly low restricted 
r-square (0.177 on a scale where l.o » perfect equality for all 
observations) . Hours worked per week also is associated with a 
low restricted r-square (0.284). Ending date and earnings are 
associated with somewhat higher values (0.700 and 0.532, respec- 
tively). For all four variables employee reports can be predicted 
by a linear function of employer reports more accurately than by 
exact equality. The unrestricted r-square (0.504) for starting 
date shows substantial improvement over the restricted r-square. 
The other three unrestricted r-squares all exhibit statistically 
significant increases over the restricted r-squares, but the 
magnitude of the improvement is smaller than for starting date. 

The degree of inaccuracy of the dates, hours, and earnings 
reports of employees depends on how accurate one presumes employer 
reports to be. If employer reports are perfectly accurate, then 
the r-squares are estimates of reliability, and these are quite 
low by social science standards. On the other hand, if employer 
reports are assumed to be as inaccurate as employee reports, then 
correlations rather than r-squares between employee and employer 
reports estimate reliability of employee reports. These correla- 
tions are about the same magnitude as reliabilities for short 
attitude scales in the social science literature. 

In assessing these results it is important to recognize that 
employee reports referred to an earlier time point than employer 
reports, and wording of questions and manner of constructing 
operational definitions of variables differed somewhat between 
employees and employers, still, the starting date of the job 
should not be affected by the timing of the surveys, and the 
operational procedures were essentially identical for the two 
rfespondents. Yet, starting date is the least accurately measured 
of the four variables. Poor recall of employees may be the pri- 
mary explanation of this result. 

The evidence regarding employee-employer agreement about 
whether the employee was still working at the firm at the time of 
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the Interview Is somewhat ambiguous because the reference time 
point for employees was earlier than for employers. Only 3 per- 
cent of the former clients whom employers reported as still em- 
ployed reported themselves not to be with these employers. The 
major source of discrepancies was just the reverse: former 
clients who said they were employed but their reported employers 
said they were not. It is likely, of course, that between the 
contact with the employees and their reported employers, some 
employees left these jobs. 

Since most JTP clients in the employer survey were still 
working at the firm at the time of the interview and there are 
many possible reasons for leaving a firm, the table crossclassi- 
fying employee with employer stated reason for leaving has many 
cells with no entries and all remaining cells with few cases. 
Based on this limited evidence, it is apparent that the primary 
discrepancies between employee and employer reports concern being 
fired. Not in one instance out of 4 employee reports of being 
fired and 21 employer reports of firing do the reports agree. 

The favorable opinions held by employers regarding JTP and 
JTP clients are encouraging. It seems likely that these opinions 
reflect the fact that, as shown in the title IIA statewide report 
(Hotchkiss and Smythe 1387), the programs do work as intended. It 
must be kept in mind, though, that most employer responses are 
neutral, and the response rate for part 1 :>f the employer survey 
is fairly low. 

The low to moderate accuracy of employee reports of dates of 
employment, hours, and earnings must be a cause for concern. 
Averages of employee and employer reports are nearly equal. 
Hence, aggregate analyses such as those conducted by DOL using 
means may be fairly accurate. We have not examined means by SDA, 
however, due to the small sample size. Also, measurement error 
generally inflates variances which, in turn, inflate standard 
errors of the mean. Since standard errors become measurement 
errors in aggregate analyses, the measurement error at the indi- 
vidual level remains a barrier to accurate aggregate analyses, 
though its impact is much reduced with aggregate data. 

The results here suggest that it would be useful to — 

o improve procedures for obtaining employment and 
earnings data from employees and 

o improve assessment procedures for determining the 
accuracy of employee reports. 

Improving measurement procedures may depend on diagnosing the 
errors. The diagnosis must depend on carefully formulated checks 
between employee reports and employer records. Alternative 
methods of asking employees employment and earnings questions 
should be tried and compared to employer reports to determine 
which is most accurate. A larger sample than the employer sample 
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u««c httr« is i»p«rativ«. Rttfarttnctt datas must ba aatchad for 
•aployaaa and aaployars. Quastlons auat also ba carafully matchad 
•o that thay partain to praciaaly tha aana infoniatlon.* 



* For axaapla, in tha prasant casa the earnings question 
directed to enployees asked about all earnings, not just those 
froB the *\rm included in the employer survey. 
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Appropriate Solutions Incorporated 

1357 W. Lane Avenue -Suite 207 



PART 1 

INSTRUCTIONS: please answer each question cakefully. 

IF YOU ARE NOT CERTAIN ABOUT ANY 
answers, please give us YOUR BEST 
ESTIMATE. 



^ u \'^!^i!t^ e-ployeei have bcci IbvoUH 

la tk« JTPA/PIC pr*graM. If arc aot aware of tax of your cnpleycci b«lag la tkls 
pretraa. yaa will U aaabU to coaif Ittc tbli ^acitloaaalrc. PIcaic check the box below, 
coapltto the dotatl paft for tbc CMploy«c(i) rcqucitcd, aad rctara the sarvcy foraii to as 
la th« cavtlopc prtrUoi. 

I ] I am unaware of im employees participating in JTPA. 



The f^lowiag series of qaestloas asks yoa to compare your typical employees who hav 
bcea throafh JTPA/PIC with yoar typical employees who have aot beea throaeh sacb a 
prograau 

niAImajaaamjaJBtm 

KoOnintoa 



131 


121 


111 


121 


a. 


RciHoic skills 


I3l 


I2l 


111 


l2l 


• 

0. 


lotcrvlcwiig skills 


l3l 


l2l 


111 


I2l 


c. 


Enploycc appcarascc 


131 


121 


HI 


121 


d. 


ConMMBkatloB skHls 


131 


121 


111 


121 


to 


Matk aad conpatalloc skills 


131 


121 


111 


121 


f. 


Tralaiag tkat employees have when Ihey are hired 


131 


121 


111 


121 




Ability to get aloog with fellow employees 


131 


121 


HI 


121 


h. 


Overall work attltade 


131 


121 


111 


121 


I. 


Employee tnraover 


131 


121 


111 


121 


I 


Absfstilcm and Tardiness 


131 


121 


111 


121 


k. 


Employtt theft and vandalism 
















tnAMaaSsBtn 


kite 


m 


131 


121 


111 


12 1 


t 


Amonnt of training required after hired 


131 


121 


ID 


l2l 


■I. 


Snpervtslon needed 
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3. How would you rate the gulllx of 
work done by employees who were 
previously JTP A/PIC partlclpauts 
compared to your other employees 
who do similar work? 

[5] JTPA«nployMproviat]|Uuh.bttltt«u^^ 
i 3) No difftmiM in <;u«Uly of vofk 

[3) D«i"tkBow 



4. How would you rate the productUltv 
of employees who wer(^ previously 
JTPA/PIC participants compared to 
your other employees who do similar 
work? 

(5) JTPA mploxtM providt fflysLom 

producihrily 
I A) JTPAtraploy«Mpi«fvld«iDfiaP«^^KUvHy 
[3) NodiltotnMlaquftlilyorwork 
[2] JTPAtinploy«M provide ]sitP«^ueUvily 
[1] JTPA tmplorMt prwfia« mysJUm 

pcoduclhrlly 
1 3] Dootkuov 



S. Do you feel that JTPA/PIC Is a good 
source of skilled labor? 

151 Alwmyi 
(41 UtuaUy 

l2) Rmly 
[1] N«v«r 
[3] Nooptaioii 



6. How many JTPA participants has 

your firm hired In the last 12 months? 

pMticipMiU 
(. I DonHknow 



7, What Is the average length of 
employment for JTPA/PIC 
participants In your firm? 

(2 1 lloSmonllM 
(5] 4loemonllM 
|B] TieemMillw 
111 lOlollmNiUM 

Mom IhMi IS montlM 
[• ) DooH know 
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8. When considering the costs versus the 
benefits of hiring typical JTPA/PIC 
participants, do you feel that: 

[ I] Cotif oulwtifh Ibt iMntfiU 

(3) Btn«fits culwtifh Iht costs 

[2] Costs snd bsn«fiu m »bout ths smm 

[21 Koophaen 



9. How likely Is your firm to hire 

additional JTPA/PIC participants in the 
future? 

151 VsryUktly 
[A l Somswhat Uksly 
[2 ] Not vtry liksly 
[1] NolUftUUktly 
[3] Don't know 



10. How Important are the following factors 
in deciding to hire JTPA/PIC 
participants? A "1" Is g^trgmelv 
important and a "S" ll not it ill 
important. Circle the appropriate 
number, 

ft. Iiowsr rseruitmsnt cost 

(5 A 3 2 1) 

S S S 4 S b. liowsr tratning cost 

(5 A 3 2 1) 
S S 8 4 S c. Subsidy providsd 

(5 A 3 2 1) 
S S S 4 S d. Hslp our corponts imM* 

t c. Othsr - plsMS dsscribt: 



*NtiiDeric values in parentheses ai 
those us^d in statistical 
calculations. . . 

11. Which of the following categories best 
describes your business? 

[ ] Agriculturs, fortstry, fUhinf 

I I Mining 

[ 1 Construction 

[ j Mnnufftcturinf 

[ i Trsntportation, communications, slsctric, fts, 

ssnitsry tsnrlcss 

[ ) Wholssftis tnds 

[ ) RstsU trads 

[ ] Plnsnes, insurancs, rsftl sst»ts 

[ i iorvkss 

[ ] Qovsmnsnt 



12. How many people are employed by your 
organisation: 

At this location 



Total company, all locations 

36 



••i i}»9mnm la tM iHCt Nl^w. rittM Mtari this 4iitit|9«Mlrt with tU •mpUy 
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PART 2 



INSTRUCTIONS 

Tht ptrsoi listed below has participated li JTPA/PIC. The tlx questions pertain 
to this person's employment with yonr company. 

Compiay: 
Employee: 

Social Security Number: 

1. A Date employment began: 

B Date employement ended, if ended: 

2. If employment has ended, please indicate the primary reason: 

[ ] Laid Off [ ] Health Problem 

[ ] Quit [ ] Job Ended 

[ 1 Fired [ ] Took Other Job 

[ 1 Other - please explain: 

3. Average number of hours worked per week: 

4. A Hourly wage when hired: 

B Hourly wage currently, or when ended: 

5. Were you aware this person participated in JTPA/PIC? 

I 1 Yes I 1 No 

6. Did you receive a subsidy to tri^in this worker? 

I 1 Yes I 1 No 

Please Return tot 

JTPA/PIC Evaluation Center 
Appropriate Solutions, Inc. 
1357 W. Lane Av. - Suite 207 
Columbus, OH 43221-3590 
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APPENDIX B 
EMPLOYEE SURVEY 



86015/2 - Page 1 



Start Time: ( jc [ ] CP ( jt 

Appropriate Solutions. Inc. I'm calling for the National 

Center at Ohio State University in Columbus. Ohio. May I speak with 1 R NAME I? 

We recently sent you a letter explaining that we are contacting people who took part 
in JTPA programs in Ohio to ask them about their experiences after leaving the 
program. ^ 

We are collecting information for a 13 week period from 1 DATE 1 I 

to I PATE 3 I ^ . These questions will only take a few minutes and 

your answers will help to improve these programs. mmuics ana 



I. do any for pay during the last week of this period between 
Sunday I PATE Z I and Saturday I DATE 3 1 



7 



I No --— > I GO TO Q 2 I 
2 Yes 



a. How much did you get paid for work you did during that week, before 
any deductions? Include wages on all jobs you may have worked 
including tips, overtime, bonuses, commissions and any work from self 
employment. 

I I ^1 I $ per week 



'■if..? ANSWER IN K, PER WFFK . PF rpRp amount amh 
INDICATE PE RIOD WORKED IN 13TH wriiTl 

$ per: [ ] hour # hrs:^ 



[ ] day -- # days: 



( ] biweekly ( ] month [ ] year 

Now I want to ask you about the entire 13 week period from Sunday, 

I PATE 1 I to Saturday I DATE 3 I , 

inclvding the week we just talked about. How many weeks did you 
work at all for pay during the 13-week period? 

I INCLUDE ALL WEEKS IN WHICH R WORKED. OR WAS ON PAfP 
SICK LEAVE OR PAID VACATip fJ | 

I I I weeks 1 MIN m 01 MAX « i:< i 



35 

10 



MOlS/2 . Pa|« 2 



1 



No • 
Ym 



1 



2a. 



Wert you lookini for work in the four weeks before 
I DATK .1 I J 



1 



Ym 

No 



•> I CO TO Q i I 




2a 1) What was the miitt reason you weren't looking for a job at 
that time? 

1 Attending school full-time 

2 Health problems 
3 Family care responsibilities 

4 Transportation 
S No job available, discouraged 

6 Laid off. awaiting recall 
7 Child care problems 

Other (specify) 



9 DK/NA 



I GO TO O 4 1 



2b. How many weeks did you do any work at all for pay during the 
13-week period? 

1 I t weeks — > I GO TO o 

1 MIN s 01 MAX ■ n 1 
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t. I ASK THE FOMQWING FOR each fmpi ^y f r DiiwiN(-r py pinn , 

b. When did you start and stop working for I NAME OF KMPLOYFl^ p 

c. About how many hours per week (do / did) you usually work? 

d. I IF LEFT I What was your main reason for leaving? 

1st Employer: UJJJJJJ JJJJJJJJjjjjjjjj 
Address: UJJJJJJJJJJJJJJjjjjjjjjj 

^ity: IJ_UJJJJJ_UJJJJ State IJJ Zip IJJJJJ 
Phone ( J J_J - IJJ J . I J J J J 



b. Start: UJ-|JJ-|JJ Stop l_U-|JJ-|JJ 
mo da yr mo da vr 



I CANNOT E XCEED DATF ^ 1 
9'S = DK C'S ^ .iill tmploy«d 



c. Hours per week: |JJ 



d. Reason Left: |JJ 



00 


= Still Employtd 


04 


= trftniportatton 


08 


= family rvatoni 


01 


= tind 


05 


= child cm 


09 


= rtturnKi to school 


03 


= laid off 


06 


= took othtr job 


10 


= lots of wtlfart btntftts 


03 


= Job tndtd 


07 


= htaHh 


11 


= company doMd 


90 


= DK/NA 









Other: 



r ] I CHECK IF SELF EMPI Oy Fp | 

e. What type of business is I 1st EMPLOVfr i involved in? Is it -- 

I Manufacturing 4 Federal, state, or local government 

2 Retail sales 5 Or some other? 

3 A service business 9 DK/NA 



2, d Employer: UJ JJJJJJJJ J JJ J JJ J J J j j j j j j j j j j_ , 

b. Start: IJJ-I J J-|JJ Stop U_HJJ-|JJ I CANNOT EXCEED DATE I I 

" mo da yr 9.3 = DK O'S = .till .mploy.d 

c. Hours per week: |JJ d. Reason Left: |JJ 

Other:. 



ERIC 37 



86015/2 . Page 4 

3rd Employer: U-LJJJJJ_U_LUJJJJJJJJjjj^j_,_,jj 

"•''""-is^r^-J ' CANNOT rvrr.n n^TF ^1 

o« yr mo da yr g,.DK o-s-^i ««pioy«i 



c. Hours per week: LJ_J 



d. Reason Left: |_J_j 



00 - SMU Bwploytd 

01 > and 
OS>hU«* 
OS>Jeb«MlKl 
W « DK/KA 



04 = trMMpertaliM 
01 «cltiklcM« 

06 = took otkw Job 

07 = lMaMi 



00 = fMnily NMOM 

00 = ratumad to achool 

10 = loM of mtUmn bamfiti 

11 3 eompwiy eioMd 



Other: 



From 1 DATE I 1 



toUiAIEJJ 



ii'j.tJI!.!.'" ^W*^ education or training programs to improve your 
education or job skills other than in a JTPA Program? 



did you 



No 
Yes 



b. 

c. 

d. 

Type 
of school 



What kind of school did you attend? f LIST TVPF. nv SCHOOL IN 
COL 1. and ASK O TO ^ rn, ir.rLV^|fl!ft!>MJ ^^"^ ^^ 

When did you start and stop attending this program? 

I IF STOrrEP I Did you complete it? I CANNOT BE AFTEP p fi^Jl 3 | 

How many hours per week (do / did) you attend the program? 



Started 



Stopped 



Completed 



Hour s 



u 



UJ-UJ-UJ UJ-IJJ-UJ 1 Yes 
nio da yr mo da yr 2 



No 



UJ 



U 



UJ-U_J-UJ U_J-U_JHJJ 
n>o da yr mo da yr 



Yes 

No 



UJ 



1=4 Ytftr colWf* 
I :r I Ytftr COUtft 

S = OUMr 



3 s Public ichool 

4 » PtivftU trminittf 

0» DK/NA 



= DK/NA 
0*8 = •till in school 



What is the highest grade or level of education you have completed? 



01 Eighth grade or less 

02 Ninth grade 

03 Tenth grade 

04 Eleventh grade 

OS High school graduate 

06 G.E,D. 



07 1 yr post HS • no degree 

08 2-3 yr post HS - no degree 

09 Associate degree 

10 College graduate 

1 1 Master*s degree 

12 Doctoral degree 

99 DK/NA 
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In what month and year were you last enrolled full time in school not counting 
t JTPA Program? 

I I l-l I I » = DK/NA 

mo yr 



How many of the years since that time have you worked at least 6 months? 
I I I I MAX » 87 > 06 I M = DK/NA 



In the twelve months bef ore you started with JTPA, how many total weeks did 
you work 20 hours or more? 

I I I weeks I MAX « S2 1 m = dk/na 



Including yourself, how many people in your family lived in the same house 
with you during the past year? 

I I ) 99 = DK/NA 



Now rd like to ask you about financial support or assistance you or any of 
your family living with you were receiving during the week from I DATE 2 1 
to t DATE 3 1 . 



Were you receiving any public assistance from ADC? 



1 No 

2 Yes > 

9 DK/NA 



al) What was the monthly amount you received? 
I I I I I $ per month 



b. Were you receiving any General Relief? 



1 No 

2 Yes > 

9 DK/NA 



bl) What was the monthly amount you received? 
I I I I $ per month 



c. Were you receiving Food Stamps? 



1 No 

2 Yes > 

9 DK/NA 



cl) What was the monthly amount you received? 
I I I I ^1 $ per month 



Did you have a Welfare Medical Assistance Card? 



1 No 
2 Yes 
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Were you receiving Refugee Funds? 



1 No 

2 Yei > 

9 DK/NA 



el) Whit was the monthly tmount you received? 
I I I I I $ per month 



Were you receiving SSI from Social Security? 



1 No 

2 Yes > 

9 DK/NA 



f I) What was the monthly amount you received? 
I I I . I I $ per month 



11. Over the last 12 months, what would be your best estimate of the total income 
from yourself and gU the family members who lived with you? This would 
inciude tli income, from wages and salary as well as any cash assistance or 
support. This does not include the value of Food Stamps. 

I 1 I I $ per year = Don't Xne» 

h'i = IUftiMd 

12. Do you recall the month and year that you left the JTPA Program? 

I I H I I 9'i = DK/NA 

"»0 yr O'l = Not in ProfTMi > I SKIP TO FND I 



13. Would you say that the program or training you were in was excellent, good, 
fair or poor? 

I Excellent 

3 Fair 
4 Poor 
9 DK/NA 



Do you think the program or training you had helped you a great deal, helped 
you some, helped you a little, or didn't help you at all? 

1 Helped great deal 

2 Helped some 

3 Helped t little 

4 Didn*t help at til 

9 DK/NA 



I want to thank you very much for your cooperation and taking the time to share this 
information with me. 



END TIME: UJ-IJJ-IJJ 




da yr Interviewer Signature 

Date of Completion 
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